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DETAILED ACTION 

1 . This communication is responsive to Amendment, filed 1 1/06/2006. 

2. Claims 1, 2, 7-23, 28-33, 37, 38, 40 and 41 are pending in this application. Claims 1, 22, 
37, 38, 40, 41 are independent claims. In the Amendment, claims 6, 27, 34-36, 39, 42 have been 
cancelled, and claims 1-2, 7-15, 17-23, 28-33, 37, 38, 40, 41 have been amended. This action is 
made Final. 

Claim Rejections - 35 USC § 103 

3. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 

This application currently names joint inventors. In considering patentability of the 
claims under 35 U.S.C. 103(a), the examiner presumes that the subject matter of the various 
claims was commonly owned at the time any inventions covered therein were made absent any 
evidence to the contrary. Applicant is advised of the obligation under 37 CFR 1.56 to point out 
the inventor and invention dates of each claim that was not commonly owned at the time a later 
invention was made in order for the examiner to consider the applicability of 35 U.S.C. 103(c) 
and potential 35 U.S.C. 102(e), (f) or (g) prior art under 35 U.S.C. 103(a). 
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4. Claims 1, 2, 7-9, 12-14, 16, 22, 23, 28-30, 37, 38, 40, 41 are rejected under 35 U.S.C. 
103(a) as being unpatentable over Konishi et al. (US Pub. No. 20020003576), in view of Lundin 
et al. (US Pub No. 20020093439). 

As to claims 1, 37, 40, Konishi teaches a method of storing data, said method comprising 
the steps of: 

storing data, as one or more data samples (i.e, frame Al, Bl, CI in Fig. 1 OB), in a media 
file (i.e. video files) configured for use by a media player application in playing the data samples 
(i.e. Since the information processing device can treat the video camera apparatus as a storage 
device, motion video files between the information processing device and the video camera 
apparatus can be easily exchanged, [0022]); and 

storing (i.e. record the index image on the recording medium, [0021]), an index file (i.e. 
INDEX FILE, Fig 24) associated with the media file (i.e. VIDEO FILE, Fig. 24), information for 
instructing the media player application where to find each of the data samples in the media file 
(i.e. The contents of each motion video file on the recording medium can be easily estimated 
from its index image, [0021]) wherein the media file fiirther comprises additional information 
(i.e. time-stamp TSI, TS2, TS3, Fig. lOB) interspersed throughout the media file (i.e. a time 
stamp representing the real time is added for each encoded frame to a bit stream obtained by the 
MPEG4 encoder 201, [0100]), wherein the additional information comprises at least a timestamp 
(i.e. the time stamp value of each frame added to the compression-encoded motion video signal 
recorded as the motion video file, [0019]) indicating a capture time (i.e. Captured images, 
[0100]) of an associated data sample (i.e. a time stamp representing the real time is added for 
each encoded frame to a bit stream obtained by the MPEG4 encoder 201, [0100]), wherein the 
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additional information of the media file is used in reconstructing the index file file (Le. a time 
stamp representing the real time is added for each encoded frame to a bit stream obtained by the 
MPEG4 encoder 201, If the encoded file is directly decoded and reconstructed, an image is 
undesirably reproduced using a time taken for actual video shooting, [0100]), 

Konishi does not specifically teach the additional information of the media file is used in 
reconstructing the index file upon corruption of the index file. 

Lundin teaches the additional information of the media file is used in reconstructing the 
index file (i,e. Building a ''Super-Index'' for Correction Table Indexing, [0143]) upon corruption 
of the index file (i.e. The correction calculator 465 computes table entries (e.g, the values of 
S.sub.i) for the correction table 350 using the digital output signal x(k) along with the calculated 
(k)from the FIR filter 455, [0049]), 

It would have been obvious to one of ordinary skill of the art having the teaching of 
Konishi and Lundin at the time the invention was made to modify the system of Konishi to 
include the additional information of the media file is used in reconstructing the index file upon 
corruption of the index file as taught by Lundin, One of ordinary skill in the art would be 
motivated to make this combination in order to reconstruct the analog input signal in the digital 
domain in view of Lundin, as doing so would give the added benefit of having at least a portion 
of a current sample, at least portion(s) of one or more previous and/or subsequent sample(s) 
used to build (e.g., by bit concatenation) an index for addressing a correction table memory as 
taught by Lundin (^^0070/;. 
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As to claims 22, 38, 41, Konishi teaches a method of storing video and associated text 
data, said method comprising the steps of: 

storing the video and associated text data (7.e. The ASF file format is used to provide 
multimedia data as streaming data via a network and can include not only videos but also 
speech and texts in the same ASF file data, [0071 ]) as one or more data samples (7. e. fi-ame A 7, 
Bl, CI in Fig. lOB), in a media file in accordance with a first file format (i,e, VIDEO FILE, Fig, 
24), the media file being configured for use by a media player application in playing the video 
data (i.e. Since the information processing device can treat the video camera apparatus as a 
storage device, motion video files between the information processing device and the video 
camera apparatus can be easily exchanged, [0022]); and 

storing (7.e. record the index image on the recording medium, [0021]), in an index file 
(i.e. INDEX FILE, Fig, 24) in accordance with a second file format (i,e, VIDEO FILE, Fig. 24), 
information for instructing the media player application where to find each of the one or more 
data samples in the media file (i,e. The contents of each motion video file on the recording 
medium can be easily estimated from its index image, [0021]); and 

adding additional information (i,e. time-stamp TSl, TS2, TS3, Fig, lOB) interspersed 
throughout the media file (i,e, a time stamp representing the real time is added for each encoded 
frame to a bit stream obtained by the MPEG4 encoder 201, [0100]), the media file including the 
additional information being readable by the media player application corresponding at least to 
the first file format (i,e, when the video camera apparatus 11 is connected to the personal 
computer 13 via a USB interface, the personal computer 13 issues a request of acquiring the 
device type by a plug-and-play function, [0135]), the additional information comprises at least a 
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timestamp for one or more of the data samples (Le, the time stamp value of each frame added to 
the compression-encoded motion video signal recorded as the motion video file, [0019]), each of 
the timestamp indicating a capture time (i.e. Captured images, [0100]) of an associated data 
sample (i,e, a time stamp representing the real time is added for each encoded frame to a bit 
stream obtained by the MPEG4 encoder 201, [0100]), wherein the additional information of the 
media file is used in reconstructing an index file (i,e, a time stamp representing the real time is 
added for each encoded frame to a bit stream obtained by the MPEG4 encoder 201, If the 
encoded file is directly decoded and reconstructed, an image is undesirably reproduced using a 
time taken for actual video shooting, [0100]). 

Konishi does not fairly teach the additional information of the media file is used in 
reconstructing the index file upon corruption of the index file. 

Lundin teaches the additional information of the media file is used in reconstructing the 
index file (i,e. Building a "Super-Index" for Correction Table Indexing, [0143]) upon corruption 
of the index file (i.e. The correction calculator 465 computes table entries (e.g., the values of 
S.subA) for the correction table 350 using the digital output signal x(k) along with the calculated 
(k)from the FIR filter 455, [0049]). 

It would have been obvious to one of ordinary skill of the art having the teaching of 
Konishi and Lundin at the time the invention was made to modify the system of Konishi to 
include the additional information of the media file is used in reconstructing the index file upon 
corruption of the index file as taught by Lundin. One of ordinary skill in the art would be 
motivated to make this combination in order to reconstruct the analog input signal in the digital 
domain in view of Lundin, as doing so would give the added benefit of having at least a portion 



Application/Control Number: 10/748.334 Page 7 

Art Unit: 2167 

of a current sample, at least portion(s) of one or more previous and/or subsequent sample(s) used 
to build (e.g., by bit concatenation) an index for addressing a correction table memory as taught 
by Lundin ([0010]). 

As to claims 2, 23, Lundin teaches the additional information is used exclusively for 
reconstruction of the index file (ue. The correction calculator 465 computes table entries (e.g., 
the values ofS.subA) for the correction table 350 using the digital output signal x(k) along with 
the calculated (k)from the FIR filter 455, [0049]). 

As to claims 7, 28, Konishi teaches the additional information comprises a resolution of 
an associated sample (i.e. The default motion video shooting and recording mode is set to a mode 
at a lower bit rate than in the use of the PCMCIA card type hard disk drive 122 as a recording 
medium, e.g., NORMAL as a predetermined resolution in the VIDEO mode, or to the INTERNET, 
mode, [0144]). 

As to claims 8, 29, Konishi teaches the information of the index file comprises firame rate 
variation information (i.e. encoding at a target frame rate, [0017]). 

As to claims 9, 30, Konishi teaches the additional information is stored as one or more 
dedicated samples of the media file (i.e. exchange of motion video data between the camera and 
the computer requires dedicated software, [0011]; a motion video encoding section which 
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performs compression encoding including intra-frame encoding and inter-frame encoding for a 
motion video signal input from the solid state image sensor, [0013]), 

As per claim 12, Konishi teaches the data is video data (i.e, VIDEO FILE, Fig, 24). 

As per claim 13, Konishi teaches the data is text data (i.e. The ASF file format is used to 
provide multimedia data as streaming data via a network, and can include not only videos but 
also speech and texts in the same ASF file data, [0071]). 

. As per claim 14, Konishi teaches the data is video data and associated text data (i.e. The 
ASF file format is used to provide multimedia data as streaming data via a network, ond can 
include not only videos but also speech and texts in the same ASF file data, [0071]). 

As per claim 16, Konishi teaches each video sample is a separate JPEG file (i.e. The still 
video compression/decompression section 114 compression-encodes the input video signal in a 
JPEG format, [0060]). 

5. Claims 15, 33 are rejected xmder 35 U.S.C. 103(a) as being unpatentable over Konishi et 
al. (US Pub. No. 20020003576), in view of Lundin et al (US Pub No. 20020093439), and further 
in view of Esbensen (US Patent No. 7,124,427). 

As to claims 15, 33, Konishi and Lundin do not specifically teach the video and 
associated text data are captured for security purposes. 
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However, Esbensen teaches the video and associated text data are captured for security 
purposes (i.e. As a result, playback image quality is often very poor and when an incident does 
occur, investigators cannot get a clear enough image of individuals involved in the incident to 
make an identification. In response to this problem, the Federal Bureau of Investigation has 
established a laboratory program whose primary function is to help law enforcement personnel 
enhance poor quality images from video surveillance systems in order to aid in investigations, 
col. J, lines 34-51). 

It would have been obvious to one of ordinary skill of the art having the teaching of 
Konishi, Lundin and Esbensen at the time the invention was made to modify the system of 
Konishi and Lundin to include the video and associated text data are captured for security 
purposes as taught by Esbensen. One of ordinary skill in the art would be motivated to make this 
combination in order to playback stored incidents in view of Esbensen (col. 9, lines 16-28), as 
doing so would give the added benefit of providing a flexible surveillance system that can 
capture image data from a number of digital cameras and make that data available to viewers in a 
variety of different ways as taught by Esbensen (col 2, lines 19-30). 

6. Claims 10, 1 1, 21, 31, 32 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Konishi et al. (US Pub. No. 20020003576), in view of Lundin et al. (US Pub No. 20020093439), 
and further in view of Lin (US Patent No. 6,369,835). 

As to claims 10, 31, Konishi and Lundin do not explicitly teach the media file is 
configured in accordance with the Microsoft AVI file format. 
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However, Lin teaches the media file is configured in accordance with the Microsoft AVI 
file format (i.e. In accordance with still further aspects of the invention, a movie application 
programming interface (API) such as ''QuickTime" and "Video for Windows" may be selected to 
save the movie data in the movie file. File attributes (e.g., type or extension such as ".qtm", 
".mov", ".avi" or "MooV") may be set on the movie file. Also, the type of the file extension 
attribute may be selected to indicate the format of the movie data in the movie file (coL 3, lines 
3-10). 

It would have been obvious to one of ordinary skill of the art having the teaching of 
Konishi, Lundin and Lin at the time the invention was made to modify the system of Konishi and 
Lundin to include the media file is configured in accordance with the Microsoft AVI file format 
as taught by Lin. One of ordinary skill in the art would be motivated to make this combination in 
order to select the type of compression method and optimization of the compression method in 
view of Lin (col. 2, line 66 to col 5, line 2), as doing so would give the added benefit of a 
method and system for transforming slides for a slide show presentation into movie data and 
saving the movie data in a movie file for display as a movie by any program capable of playing 
the movie file as taught by Lin (col. 7, lines 5-12). 

As to claim 11, 32, Konishi and Lundin do not specifically teach the media file is 
configured in accordance with the Apple QuickTime file format. 

However, Lin teaches the media file is configured in accordance with the Apple 
QuickTime file format (i.e. In accordance with still further aspects of the invention, a movie 
application programming interface (API) such as "QuickTime" and "Video for Windows" may be 
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selected to save the movie data in the movie file. File attributes (e.g., type or extension such as 
".qtm'\ ".mov'\ ".avV or "MooV'*) may be set on the movie file. Also, the type of the file extension 
attribute may be selected to indicate the format of the movie data in the movie file (col. 5, lines 
3-10). 

It would have been obvious to one of ordinary skill of the art having the teaching of 
Konishi, Lundin and Lin at the time the invention was made to modify the system of Konishi and 
Lundin to include the media file is configured in accordance with the Apple QuickTime file 
format as taught by Lin. One of ordinary skill in the art would be motivated to make this 
combination in order to select the type of compression method and optimization of the 
compression method in view of Lin (col. 2, line 66 to col. i, line 2), as doing so would give the 
added benefit of transforming slides for a slide show presentation into movie data and saving the 
movie data in a movie file for display as a movie by any program capable of playing the movie 
file as taught by Lin (col. 1, lines 5-12). 

As per claim 21, Konishi and Lundin do not fairly teach the index file contains a track 
referencing at least the media file. 

However, Lin teaches the index file contains a track referencing at least the media file 
(i.e. The parameter atom 412 indicates a type, identification, index iind data. For example, 
type=KActionParameter, id=0, index=KFirstParam and data that includes parameter data. A 
target atom 414 and a sprite target atom 416 are shown included in the action atom 408. 
However, the target atom 414 and the sprite target atom 416 are usually only included when the 
action is not to be performed on a default track and sprite (col. 18, lines 35-47). 



Application/Control Number: 10/748,334 Page 12 

Art Unit: 2167 

It would have been obvious to one of ordinary skill of the art having the teaching of 
Konishi, Lundin and Lin at the time the invention was made to modify the system of Konishi and 
Lundin to include the index file contains a track referencing at least the media file as taught by 
Lin, One of ordinary skill in the art would be motivated to make this combination in order to 
display the slide show presentation when the movie file is played in view of Lin (coL 2, lines 49- 
59), as doing so would give the added benefit of transforming slides for a slide show presentation 
into movie data and saving the movie data in a movie file for display as a movie by any program 
capable of playing the movie file as taught by Lin (coL /, lines 5-12). 

7. Claim 17 is rejected under 35 U.S.C. 103(a) as being unpatentable over Konishi et al. 
(US Pub. No. 20020003576), in view of Lundin et al. (US Pub No. 20020093439), and fiirther in 
view of Yamada et al. (US Patent. No. 6,804,302). 

As per claim 17, Konishi and Lundin do not specifically teach a plurality of copies of a 
corresponding text string are included in each text sample of media file. 

Yamada teaches a plurality of copies of a corresponding text string are included in each 
text sample of media file (i.e, text memory 103 stores a source of text ... and text decoder 107 
decodes a character into frame components, col 4, lines 46-56). 

It would have been obvious to one of ordinary skill of the art having the teaching of 
Konishi, Lundin and Yamada at the time the invention was made to modify the system of 
Konishi and Lundin to include the limitations as taught by Yamada. One of ordinary skill in the 
art would be motivated to make this combination in order to decode a character into frame 
components in view of Yamada, as doing so would give the added benefit of providing a 
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technique of editing a multimedia title which comprises various sources such as motion pictures, 
still pictures, text data, background still image, graphics, and a scenario describing the source 
list, presentation method and characteristics of the sources into video signals as taught by 
Yamada (col, 7, lines 8-17), 

8. Claims 18, 19 are rejected under 35 U.S.C. 103(a) as being unpatentable over Konishi et 
al (US Pub. No. 20020003576), in view of Lundin et al. (US Pub No. 20020093439), and 
Yamada et al. (US Patent. No. 6,804,302), and further in view of Lin (US Patent No. 6,369,835). 

As per claim 18, Konishi, Lundin, and Yamada do not fairly teach a first copy of the text 
string is configured in accordance with the AVI file format. 

However, Lin teaches the AVI file format (i.e. In accordance with still further aspects of 
the invention, a movie application programming interface (API) such as ''QuickTime" and 
"Video for Windows" may be selected to save the movie data in the movie file. File attributes 
(e.g., type or extension such as ".qtm", ".mov'\ ".avi" or "MooV") may be set on the movie file. 
Also, the type of the file extension attribute may be selected to indicate the format of the movie 
data in the movie file (col. 3, lines 3-10). 

It would have been obvious to one of ordinary skill of the art having the teaching of 
Konishi, Lundin, Yamada, and Lin at the time the invention was made to modify the system of 
Konishi, Lundin, and Yamada to include the limitations as taught by Lin. One of ordinary skill 
in the art would be motivated to make this combination in order to select the type of compression 
method and optimization of the compression method in view of Lin (col. 2, line 66 to col. 3, line 
2), as doing so would give the added benefit of a method and system for transforming slides for a 
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slide show presentation into movie data and saving the movie data in a movie file for display as a 
movie by any program capable of playing the movie file as taught by Lin (col. 1, lines 5-121 

As per claim 19, Konishi, Lundin, and Yamada do not specifically teach a second copy 
of the text string is configvired in accordance with the QuickTime file format. 

However, Lin teaches the Apple QuickTime file format (i.e. In accordance with still 
further aspects of the invention, a movie application programming interface (API) such as 
"QuickTime*' and "Video for Windows" may be selected to save the movie data in the movie file. 
File attributes (e.g,, type or extension such as ".qtm", ",mov", ".avi" or "MooV") may be set on 
the movie file. Also, the type of the file extension attribute may be selected to indicate the format 
of the movie data in the movie file (col. 5, lines 3-10), 

It would have been obvious to one of ordinary skill of the art having the teaching of 
Konishi, Lundin, Yamada, and Lin at the time the invention was made to modify the system of 
Konishi, Lundin, and Yamada to include the limitations as taught by Lin. One of ordinary skill 
in the art would be motivated to make this combination in order to select the type of compression 
method and optimization of the compression method in view of Lin (col. 2, line 66 to col. 5. line 
2), as doing so would give the added benefit of transforming slides for a slide show presentation 
into movie data and saving the movie data in a movie file for display as a movie by any program 
capable of playing the movie file as taught by Lin (col. 7, lines 5-12). 
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8. Claim 20 is rejected under 35 U.S.C. 103(a) as being unpatentable over Konishi et al. 
(US Pub. No. 20020003576), in view of Lundin et al. (US Pub No. 20020093439), and further in 
view of Boogaard (US Pub. No. 20030033325). 

As per claim 20, Konishi and Lundin do not specifically teach the step of inserting one 
or more empty samples into the media file to compensate for any missed samples. 

Boogaard teaches comprising the step of inserting one or more empty samples into the 
media file to compensate for any missed samples (Le, The available empty frame(s) is or are 
available because the first next normal fi-ame may need the space in the empty fi'ame(s) to store 
data (bit reservoir), [0101 J), 

It would have been obvious to one of ordinary skill of the art having the teaching of 
Konishi, Lundin and Boogaard at the time the invention was made to modify the system of 
Konishi and Lundin to include the limitations as taught by Boogaard. One of ordinary skill in 
the art would be motivated to make this combination in order to avoid possible additional frames 
for a bit reservoir from being counted in the time coding of the file in view of Boogaard 
([01 01]), as doing so would give the added benefit of performing a more efficient distribution of 
unique audio and/or video files by combining the invention with the "client as server" principle, 
which uses (partial) recording of audio and/or video at the side of the individual user, while 
maintaining a method of control of the server as taught by Boogaard ([0029]), 
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Response to Arguments 

9. Applicant's arguments regarding Aksu, Chan, Courtney, Fuller do not teach the features 
of the amended claims 1, 22, 37, 38, 40, 41 have been considered but are moot in view of the 
new ground(s) of rejection. 
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Conclusion 



9. Applicant's amendment necessitated the new ground(s) of rejection presented in this 
Office action. Accordingly, THIS ACTION IS MADE FINAL. See MPEP § 706.07(a). 
Applicant is reminded of the extension of time policy as set forth in 37 CFR 1.136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within TWO 
MONTHS of the mailing date of this final action and the advisory action is not mailed until after 
the end of the THREE-MONTH shortened statutory period, then the shortened statutory period 
will expire on the date the advisory action is mailed, and any extension fee pursuant to 37 
CFR 1.136(a) will be calculated from the mailing date of the advisory action. In no event, 
however, will the statutory period for reply expire later than SIX MONTHS from the date of this 
final action. 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Miranda Le whose telephone number is (571) 272-41 12. The 
examiner can normally be reached on Monday through Friday from 8:30 AM to 5:00 PM. 

If attempts to reach the examiner by telephone are unsuccessfiil, the examiner's 
supervisor, John R. Cottingham, can be reached on (571) 272-7079. The fax number to this Art 
Unit is 571-273-8300. 

Any inquiry of a general nature or relating to the status of this application should be 
directed to the Group receptionist whose telephone number is (703) 305-3900. 

Information regarding the status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Status information for published applications 
may be obtained from either Private PAIR or Public PAIR. Status information for unpublished 
applications is available through Private PAIR only. For more information about the PAIR 
system, see http://pair-direct.uspto.gov . Should you have questions on access to the Private 
PAIR system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). 



Miranda Le 
October 27, 2004 




